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Many biological systems can sense periodical variations in a stimulus input and produce well- 
timed, anticipatory responses after the input is removed. Such systems show memory effects for 
retaining timing information in the stimulus and cannot be understood from traditional synchro¬ 
nization consideration of passive oscillatory systems. To understand this anticipatory phenomena, 
we consider oscillators built from excitable systems with the addition of an adaptive dynamics. 
With such systems, well-timed post-stimulus responses similar to those from experiments can be 
obtained. Furthermore, a well-known model of working memory is shown to possess similar antic¬ 
ipatory dynamics when the adaptive mechanism is identified with synaptic facilitation. The last 
finding suggests that this type of oscillators can be common in neuronal systems with plasticity. 
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The interaction between a dynamical system capable 
of oscillatory behavior and an external periodic stimu¬ 
lus input represents the fundamental physics underlying 
many biological and engineering systems mm Under 
the titles of synchronization or entrainment, active stud¬ 
ies have been devoted to various aspects of these systems, 
for example, the existence and degree of synchrony under 
different parameter conditions, the stability of the syn¬ 
chronous state, the influence of noise [.lj, and, recently, 
the efficiency of entrainment [3]. While these mostly in¬ 
volve how the systems enter or stay under the rhythmic 
interaction, the post-interaction behavior of the systems 
often plays important roles in many biological functions 
[4]. This potentially allows the biological systems to rec¬ 
ognize the temporal patterns in the environment and pro¬ 
duce anticipatory responses to help their survival. Ex¬ 
amples of such transient responses following the end of 
stimulus have been observed in ganglion cells of retina 
under light stimulus [5!, growth of slime mold influenced 
by varying humidity [6], and the optic tectum of zebrafish 
conditioned with moving periodic scenery [?;• However, 
the underlying physics for this time perception mecha¬ 
nism is still unclear and there is a ongoing debate on 
whether a clock is needed |8i. 

To explain the anticipative dynamics, it has been pro¬ 
posed that the periods of various lengths can be built into 
the structure of a network with loops of various sizes [9]. 
External stimulations of a particular period will then ac¬ 
tivate a particular circuit in the system to provide the 
memory effect. This implementation of “memory” with 
pre-fabricated structure is similar in spirit to the phase 
model used to understand the anticipation of slime mold 
[6]. In this phase model, oscillators with various periods 
must be first put into the system before an external stim¬ 
ulation of a particular frequency can be used to entrain 
or synchronize the oscillators with the same frequency to 


provide the anticipation effect. An obvious objection to 
this type of models of pre-fabricated structures is that a 
continuous change in external periods will not produce a 
continuous change in the response; contrary to findings 
of experiments with retina. 

In our view, the anticipation effect is the adaptation 
of a biological system to a periodic stimulation. In the 
following, we show the function of such anticipation can 
be achieved by a minimal dynamical system with two- 
dimensional oscillations controlled by a slow adaptive 
dynamics. A surprisingly well retention of periodicity 
information for a range of stimulus period can be ob¬ 
tained with single parameter adjustment, and thus can 
be easily targeted evolutionarily. Such dynamical mech¬ 
anism does not necessarily describe a dominating micro¬ 
scopic cellular process or pathway. It can also act as a 
coarse-grained, thermodynamic description for systems 
of many degrees of freedom. In a neural network model 
for working memory ma. we show an anticipative dy¬ 
namics can be produced in the mean-field level of the 
network with the adaptation coming from the residual 
calcium dynamics of synaptic facilitation. This suggests 
a validity test for our idea in experiments. Furthermore, 
our model demonstrates that the anticipative mechanism 
can be quite generic and may be wide spread in natural 
neural systems; hinting that the perception of time in bi¬ 
ological systems does not require the existence of a clock. 

To substantiate our considerations, we use a reduced 
FitzHugh-Nagumo (FHN) model [Tl] defined by the 
equations, 

dV V 3 r / X /-.X 

= V - y - w + I ext (t) , (1) 
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Note that we are just using the generic excitable proper¬ 
ties of the model to demonstrate our idea. The excited 
state of the FHN model considered here does not repre¬ 
sent an action potential and the time scale of the system 
can be much longer than the spiking dynamics typically 
associated with the FHN model. Usually, the system pa¬ 
rameter a is a constant for the FHN model. However, 
to perceive the period of a periodic stimulus input, we 
turn a into a dynamic variable, allowing the system to 
adapt to different limiting behavior. It is known that 
the dynamics of v and w can be synchronized to that of 
the periodic J ext when a and r are properly chosen. The 
adaptation of a to the external period can be written in 
general as: 


where a = g (v, w) is the entrained value of a and we as¬ 
sume that the adaptive process is characterized by a sin¬ 
gle time scale of relaxation much slower than the FHN 
dynamics (r a r). The physical meaning of such re¬ 
quirement is that the value of a will be close to the en¬ 
trained value a when there is external stimulation and 
will relax back to its resting value ao when the stimu¬ 
lation is removed. Anticipative dynamics will be mani¬ 
fested during the relaxation of a from o to ao. Our task 
is to find a reasonable form for g (v,w) to ensure the 
adaptation dynamics is stable. 

As adaptation is a slower process when compared to 
the oscillatory dynamics of the system, we expect (a) 
to depend on moments of v and w, where (•) indicates 
time-averaged values over stationary cycles of the driven 
system. It can be shown that since (v) = — (a) and 
(w) = (v) — ^ (u 3 ) + (Iext (t))j only (w) contains signif¬ 
icant information of / ext . Thus, to the lowest order, the 
function g (v,w) is of the form 

g = a c -pw (4) 

where a c and p are constant parameters that need to be 
tuned for the best behavior. To maintain a stable fixed 
point at a = ao > 1 under the adaptation dynamic Q, in 
the absence of external stimulus, the parameters in Eq. 
© should satisfy m 

a c = (1 ~p)a 0 +Py- (5) 

For a more intuitive view of the phase space, we will 
use p and ao as the control parameters for the adaptive 
dynamics. 

Figure [l] shows the response of our adaptive model to 
a transient periodic stimulation (T s = 40) with p = 0.3, 
ao = 1.2. Here, for convenience, we have used a dimen¬ 
sionless time with constants r = 10, and r a — 100. It 
can be seen in Fig. Eh that the parameter a starts from 
its resting value of 1.2 and decreases to a mean value 
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FIG. 1. (Color online) A. Sustained oscillations of a stimulus- 
induced, adaptive oscillator. The square-wave stimulus 
(shaded area) lasting for 20 cycles has an amplitude of 1, 
periods of 40, and duty ratio of 1/2. The control parame¬ 
ters for the adaptive dynamics are ao = 1.2 and p = 0.3. B. 
State space trajectory for the same process when the system 
is driven from the fixed point (red/light curve) and when it re¬ 
laxes back to the fixed point (blue/dark curve). The attractor 
manifold of the system (cyan/shaded surface) is constructed 
from the limit cycles of the simplified FitzHugh-Nagumo for 
fixed a < 1 values. The black line attached to the manifold 
consists of the fixed points for a > 1. 

of (a) « 0.8 as the stimulus J ext is applied and entrains 
the dynamics of v and w (not shown). After 7 ext has 
been switched off, a relaxes back to its original value 
ao- During the relaxation period, the system produces 
a few residual oscillations with periods close to that of 
the stimulus before returning to the resting state. This 
represents the omitted stimulus responses (OSR) [5] of 
the system, showing anticipative dynamics similar to the 
observations in, e.g., zebrafish |7]- 

Simulations similar to that shown in Fig. [l] have also 
been performed for various stimulation periods. As ex¬ 
pected, the (a) in the synchronized state is a function of 
stimulation period (see Fig. [2}^). That is, the informa¬ 
tion of the stimulation period can be stored in (a ). With 
the stored synchronized state a = (a), the anticipative 
dynamics or OSR can be seen when a relaxes back to 
ao after the external stimulation has been removed. In a 
sense, the OSR or anticipative dynamics is the byproduct 
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FIG. 2. (Color online) A. The mean value of the adaptive vari¬ 
able (a) under periodic stimulus as a function of the stimulus 
period (solid line) compared with the value of a in a non- 
adaptive FHN oscillator that satisfies Tf n (a) = T s (dashed 
line). B. Delay time of first omitted stimulus response peak 
n (solid line, left scale) as a function of stimulus period com¬ 
pared to n = T s (dotted line). The dashed curve (right scale) 
shows the amplitude of the response peak. The curves split 
into shaded area when the driven system does not settle into a 
simple limit cycle. The parameters for the adaptive dynamics 
are ao = 1.4 and p — 0.4. 

of the adaptation. 

Ideally, one expect the sustained oscillation periods 
will match the period of the stimulus input T s , the posi¬ 
tion a ~ (a) of the driven limit cycle should satisfy 

T fe ((o))«T a . (6) 

where Tf n (a) denotes the oscillation periods in the orig¬ 
inal FHN system with a static a. The inverse T* (T s ) 
is shown as the dashed line in Fig. |2]4. The value of (a), 
which is a function of the stimulus period, is plotted as 
solid line in Fig. [2] The condition © implies two of 
the curves should coincide with each other. However, 
we see significant deviation even in the region where the 
first OSR retains the stimulus period well (see Fig. [2^3). 
This suggests that other variables additional to a, such 
as the phase information in cycle of v-w oscillations, are 
also contributing to the encoding of the periodicity in¬ 
formation. Since we are interested in the general phe¬ 
nomena of a functioning anticipation, we will focus on 
the role of a single adaptive parameter for the current 
study. Additionally, one can constrain the dynamics of 
a so that condition © is satisfied, or so that one would 
have g = T { ~ 1 (T s ) for the average of Q. This likely in¬ 
volves optimizations specific to the systems of interests 
and can be a subject of future studies. 

Following |5], the effectiveness of rhythmic memory can 


be assessed by the timing of the first OSR peak right after 
the stop of the periodic stimulus. Typically, the retention 
of the information about stimulus period requires a one- 
to-one mapping of the period to the latency. As shown 
in Fig. [2^, the linear relation of the first OSR time with 
the stimulus period at p = 0.4 and ao = 1.4 shows a good 
retention of the stimulus-period information: Comparing 
with the stimulus period, the latency T\ has a constant 
delay of 15 units for the range of stimulus period from 
28 to 45. Such a delay depends on the details of the 
model and can be interpreted as the time taken by the 
system to respond to the missing stimulus. Well-timed 
OSR similar to Fig. [2^3 can also be obtained for, say, a 
different value of p or r a when the value of ao is properly 
chosen [12 . As expected from the finite oscillation range 
of our reduced FitzHugh-Nagumo model, the amplitude 
of OSR peak drops significantly outside this range. For 
a fast stimulus (small T s as indicated by the shaded area 
in Fig. [2}3), the system may not be able to settle into 
a simple limit cycle with the same small period, leading 
to a more complex behavior similar to the observation in 
M- While, for a slow stimulus, the system will return 
to the quiescent fixed point before producing an OSR. 

In our conceptual model, it should be clear that all 
we need to implement anticipative dynamics in an ex¬ 
citable system is an adaptive excitability. Interestingly, 
such a mechanism has already been used in the modeling 
of working memory (WM). Mongillo et al. [10] consider 
WM as the result of the interactions between synaptic 
facilitation and depression. As illustrated in Fig. [3J an¬ 
ticipative dynamics can also be observed in such WM 
model [14]. In a mean-field approximation [T5], the neo- 
cortical network in m is described by the firing rate E of 
the neural tissue, the available neurotransmitter fraction 
x, and the probability of synaptic release u (see supple¬ 
mentary material of m )• The parameter u there plays a 
similar role as a in our FHN model, namely, the value of 
u determines whether the stationary state of the system 
is at a stable fixed point or on a limit cycles. Further¬ 
more, the adaptation dynamic of u comes from synaptic 
facilitation mm and relates to the calcium concentra¬ 
tion of the presynaptic cell. One interpretation of such 
relation is that the perception of time is being stored in 
the calcium concentration in these cells. 

In a broader view of these systems, the transient, an¬ 
ticipative oscillations following the end of the periodic 
stimulus are similar to the burster dynamics found in 
neurosciences m where a slow variable drive the sys¬ 
tem in and out of an oscillatory region of the state space. 
Since the adaptive dynamics is much slower than the os¬ 
cillation, the trajectories of these systems mostly follow 
their attractor manifolds as shown in Figs. [T^ and [31 The 
deviations from the manifolds will diminish with further 
increase of the slowness. In this limit, the nature of the 
bifurcations is likely important in determining how the 
system will return to the quiescent state. On the other 
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FIG. 3. (Color online) Anticipative behavior of mean-field 
dynamics for a network model of working memory ma (see 
E2). The trajectory and attractor manifold are similar to 
that described in Fig. HP The inset shows time course of 
the network firing rate E driven by a square-wave stimulus 
(shaded) and its residual oscillations after the stimulus stops. 


hand, the retention of the periodicity information in the 
stimulus is controlled by the adaptive dynamics which 
sets the position of the driven limit cycle of the system. 
This information is released after the end of the stimu¬ 
lus and its manifestation is determined by the position of 
this endpoint in the state space relative to the attractor 
manifold. Our finding that the periodicity information is 
retained in the calcium level in the WM of Ho] is consis¬ 
tent with a recent report that time perception disorders 
are related to WM impairment m- In fact, experiments 
m have shown that network reverberations which is be¬ 
lieved to be related to WM are controlled by residual 
calcium level in the synapses. 

We restrict the current model to the simplest dynam¬ 
ics of adaptation under a periodic stimulus. We show the 
information of stimulus period can be well retained with 
anticipative responses in accord with the input. Such 
simplicity is not without limitations. For example, with 
a single adaptive parameter, the return to the quiescent 
state will be crossing the same region of the state space, 
which implies a necessary degradation of the periodicity 
information before the OSR subsides. To have an antic¬ 
ipative response that is transient and immune to degra¬ 
dation, a more complex model, z.e., with more variables 
or involving a bifurcation of higher codimensions [20] , is 
likely required but beyond our current discussion. On 
the other hand, experimental observations of such degra¬ 
dation in the periods of OSR will be strongly indicative 
of a similar simplistic mechanism at work. 

The use of an adaptive system to fill a biological func¬ 
tion has the benefit of being continuously tunable and 
allows easier optimization on a locally smooth landscape. 


Such mechanism has a lower circuitry design cost and is 
better suited for recurrent environmental conditions with 
varying time periods. As we have shown in this paper, 
the perception of time of such systems resides in the slow¬ 
est dynamics involved, that is, the adaptive parameter a 
in our case, or the synaptic calcium level for a neocortical 
network. 
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